Support OpenAI API server in benchmark_serving.py
#2172
+51
−32
We went looking everywhere, but couldn’t find those commits.
Sometimes commits can disappear after a force-push. Head back to the latest changes here.